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(54) Color correction of a compressed image 

(57) The present invention is a method for the color 
correction of digital images that have been compressed. 
In a preferred embodiment, aspects of the color correc- 
tion are carried out on the compressed image data to 
improve computational efficiency. One of a number of 
alternative methods is employed to accomplish the color 
correction on lossy or losslessly compressed images. 
The color transformation process accomplishes color 



correction on compressed image data in conjunction 
with compression or decompression operations. A sec- 
ond, simplified phase of the color correction may be ap- 
plied subsequently to the decompressed image data in 
certain embodiments. Accordingly, the technique has 
application to any number of color imaging systems, in- 
cluding digital printers and copiers where there is a ne- 
cessity to color correct compressed digital images. 



100 




-102 



CVCrCbJ 



PARTIAL 
DECOMP 



104 



PARTIALLY 
DECOMPRESSED 
DATA 



CC r C b ) 



^108 

PHASEI 
COLOR SPACE 
TRANSFORMATION 



^-110 

PARTIALLY 
DECOMPRESSED 
DATA 



CM 

< 

CD 
CO 
O) 

O) 
*t 
CO 

o 

CL 
LU 



132 

i ----- 

| RECOMPRESS ! 

t AND 

t STORE i 



134 

RETRIEVE | 
AND ' 
PARTIAL i 
DECOMP. j 



_Z1 



112 



COMPLETE 
DECOMP 



114 



DECOMPRESSED 
DATA 



(Y'C r Ct>) 



110 



PARTIALLY 
DECOMPRESSED 
DATA 



(Y'Cf'Cb'J 



lie 



PHASE n 
UCR/GCR 



FIG. 2 



>- 130 



120 



OUTPUT 
DATA 



(CMYOR CMYK) 



TO PRINTER 



Printed by Jouve, 75001 PARIS (FR) 



EP 0 849 936 A2 



Description 

This invention relates generally to the processing of compressed digital images, and more particularly to a method 
and apparatus for accomplishing the color correction of a compressed image so as improve the efficiency of processing 
5 of the color image. 

The present invention is directed to improving the efficiency of color correction operations. In particular, this inven- 
tion capitalizes on the need to store digitized images in a compressed format, and incorporates color correction with 
compression or decompression operations so as to accomplish certain aspects of color correction on compressed 
images in a computationally efficient manner. 

10 Data compression is required in data handling processes, where too much data is present for practical applications 

using the data. Commonly, compression is used in communication links, to reduce the transmission time or required 
bandwidth. Similarly, compression is preferred in image storage systems, including digital printers and copiers, where 
"pages" of a document to be printed are stored temporarily in precollation memory. The amount of media space on 
which the image data is stored can be substantially reduced with compression. Generally speaking, scanned images, 

75 i.e., electronic representations of hard copy documents, are often large, and thus make desirable candidates for com- 
pression. 

The present invention has application to both lossy and lossless compression schemes. The DCT (Discrete Cosine 
Transform), a variable-length encoding standard disseminated by the JPEG committee, is a lossy compression scheme 
which reduces data redundancies based on pixel to pixel correlations. The Lempel-Ziv scheme is for lossless com- 

20 pression, including for example, the LZW scheme described in US-A-4,558,302 and US-A-4,81 4,746, Like LZW, the 
Huffman scheme and other lossless compression equivalents are capable of compressing data without any loss of 
image data, albeit typically at a compression ratio that is lower than that for lossy compression. Generally, an image 
does not change very much on a pixel to pixel basis and therefore has what is known as "natural spatial correlation". 
In natural scenes, correlation is generalized, but not exact. Noise makes each pixel somewhat different from its neigh- 

25 bors, but the natural spatial correlation enables not only the compression of digital image data, but the performance 
of certain image processing operations on the compressed data. Contrariwise, in synthetic graphics and computer- 
generated text, the correlation tends to be much higher, with colors limited to a small set. The limited set of colors and 
high correlation make these image types good candidates for lossless compression, at possibly higher compression 
ratios than those achievable with lossy compression schemes. 

30 US-A-5 t 408,425 discloses a processor and method of computation for performing a discrete cosine transform. 

US-A-5,31 9,724 teaches an apparatus and corresponding method for compressing still images while remaining 
compatible with a JPEG transformation. 

US-A-4,275,41 3 discloses a color space transformation where information is placed into lookup tables and stored 
in a memory - where the lookup table relates input color space to output color space. 

55 US-A-5,581 ,376 teaches the conversion of input device signals Rs, Gs, Bs, generated by an image input terminal, 

to colorimetric values Rc, Gc, Be, the colorimetric values being processed to generate address entries into a lookup 
table to convert them to Cx,Mx,Yx,Kx colorant signals or any multi-dimensional output color space, which includes but 
is not limited to CMYK or spectral data. 

In accordance with the present invention, there is provided a method for performing color correction of a com- 

40 pressed digital image, comprising the steps of: retrieving from memory a compressed unit of image data; partially 
decompressing the compressed unit to produce a partially decompressed unit representing part of the information 
describing a region of the image in a first color space; performing color correction on the partially decompressed unit 
to produce a corrected unit in the first color space; subsequently decompressing the entire corrected unit to produce 
decompressed, corrected image data; and converting the decompressed, corrected image data into a second color 

45 space image for rendering. 

The invention further provides a method of colour correcting a digital image, according to claims 4 and 8 of the 
appended claims. 

Preferably, the compressed digital image was generated using a lossless compression method. 
Preferably, the lossless compression method was selected from the group consisting of: 

so 

Huffman encoding; 
Lempel-Ziv encoding; and 
run-length encoding. 

55 Alternatively, the compressed digital image was generated using a lossy compression method. Preferably, the 

region comprises a plurality of pixels and where the lossy compression method was discrete cosine transform. 

Preferably, the transformed coefficients further include a plurality of AC terms and where the correcting step uses 
as inputs the DC term of the transformed coefficients and at least one low-order AC term of the transformed coefficients. 
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Preferably, the correcting step comprises a matrix transformation using the transformed coefficients as an input. Pref- 
erably, the number of transformed coefficients is determined as a function of the value of the DC term of the DCT 
coefficients for each of the color separations. Preferably, the number of AC terms of the transformed coefficients is 
determined as a function of the values of a plurality of low order AC terms of the DCT coefficients for each of the color 
s separations.. 

Preferably, the region comprises a plurality of pixels. 

One aspect of the invention deals with a basic problem in digital image processing systems - the memory and 
computationally intensive operations of image processing, particularly color correction. This aspect is further based 
on the discovery of a technique that alleviates this problem. The technique accomplishes the color conversion of an 
10 image segment or block while it is in a digitally compressed form - produced by lossy or lossless compression opera- 
tions. 

This technique can be implemented, for example, by the modification of basic JPEG or LZW compression engines, 
where correction operations are performed on the compressed image data (compressed units). Accordingly, the tech- 
nique has application to any number of systems, including digital printers and copiers where there is a requirement to 
15 provide color correction of the digital image. A machine implementing the invention can include a data or image process- 
ing system having the capability of image compression. The techniques and system described herein are advantageous 
because they are efficient and result in the ability to accomplish basic image processing with little additional hardware 
or processing as compared to other memory intensive approaches. 

Embodiments of the invention will now be described, by way of example, with reference to the accompanying 
20 drawings, in which: 

Figure 1 is a generalized block diagram of an exemplary printing system providing an embodiment for the present 
invention; 

Figure 2 is a flow diagram illustrating the operations and resultant data for a generalized embodiment of the present 
25 invention; 

Figure 3 is a flow chart depicting the various processing steps in a JPEG image system operated in accordance 
with an embodiment of the present invention; 

Figure 4 is an illustration of the zigzag scanning path employed to vectorize the coefficients in a DCT coefficient 
matrix; 

30 Figure 5 is an illustration of the regions of the DCT coefficient matrix employed for various embodiments of the 

JPEG image compression process depicted in Figure 3; and 

Figure 6 is a flow chart depicting the processing steps of a lossless compression system operated in accordance 
with an alternative embodiment of the present invention. 

35 in the drawings, like reference numerals have been used throughout to designate identical elements. In describing 

the present invention, the following term(s) have been used in the description. 

The term "data" refers herein to physical signals that indicate or include information. When an item of data can 
indicate one of a number of possible alternatives, the item of data has one of a number of "values." The term "data" 
includes data existing in any physical form, and includes data that are transitory or are being stored or transmitted. For 
40 example, data could exist as electromagnetic or other transmitted signals or as signals stored in electronic, magnetic, 
or other form. An "image" is a pattern of physical light. An image may include characters, words, and text as well as 
other features such as graphics. An image may be divided into "segments," each of which is itself an image. A segment 
of an image may be of any size up to and including the whole image. 

An item of data "defines" an image when the item of data includes sufficient information to produce the image. For 
45 example, a two-dimensional array can define all or any part of an image, with each item of data in the array providing 
a value indicating the color of a respective location of the image. An item of data "defines" an image set when the item 
of data includes sufficient information to produce all the images in the set. 

A "pixel" is the smallest segment or region into which an image is divided in a given system. As used herein, each 
pixel value is a set of color space coordinates in a "color coordinate form" of an image, the color coordinate form being 
so a two-dimensional array defining the image. 

A "memory" or "storage medium" is a physical medium that can store data. Examples of data storage media include 
magnetic media such as hard and floppy disks, and magnetic tape; optical media such as laser disks and CD-ROMs; 
and semiconductor media such as semiconductor ROMs and RAMs. 

A "data unit" or "unit of data" is an item of data that a processor can access or otherwise operate on as a unit. For 
55 example, an eight-bit byte is a data unit in many data processing systems. A "block" of items of data is a number of 
items of data that form a sequence. For example, a block or segment of an image would include data or signals rep- 
resentative of image pixels within a defined region of the image. As used herein a region may be a single pixel in size 
or may consist of a plurality of pixels. 
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An operation "encodes" or "compresses" items of data, when performing the operation on the items of data pro- 
duces different items of data from which the encoded or compressed data items can subsequently be recovered. The 
operation that recovers the encoded or compressed data items is "decoding" or "decompressing." When the operation 
is "lossy", the decoding or decompressing operation only recovers data that is approximately the same as the original 
s data. 

An "image input terminal" (111") is a device that can generate or receive an image and provide an item of data 
defining a version of the image. A "scanner" is an image input device that receives an image by a scanning operation, 
such as by scanning a document. Other image input terminals include facsimile machines and computer graphic work- 
stations. 

10 An "image output terminal" (IOT) is a device that can receive an item of data defining an image and provide the 

image as output. A "display" is an image output device that provides the output image in human viewable form and a 
"printer" is an image output device that renders the image on a substrate in human viewable form. The visible pattern 
presented by a display is a "displayed image" or simply "image." 

Color correction in digital images is an image processing operation comprising two steps: a correction from 3-D. 
is device independent color space (e.g., YC r C b , RGB, XYZ, or L*a*b*) to a 3-D device dependent color space; and then 
a conversion to CMYK comprising under-color removal (UCR), gray-component replacement (GCR) and linearization 
processes. It will be appreciated, however, that for some devices, not all of the processes in the second step are 
required. For example, three color devices do not need the UCR/GCR stage Typically, the two color correction steps 
are accomplished in a single operation using a three-dimensional look-up table carrying out three-dimensional inter- 
ns polation such as that described in US-A-5,581,376. However, the color correction process may also be represented 
as the combination of two phases: a 3-3 color space correction (e.g., RGB - R'G'B') followed by a device-dependent 
color space transformation operation (e.g., R'G'B'-CMYK for four color devices). The ability to separate the color cor- 
rection process into these two steps forms the basis for the present invention, where the more difficult of the two steps, 
namely the first color correction, can be accomplished on the compressed digital data so as to significantly expedite 
25 the overall correction process. The advantage being that the 3-3 color correction operation may be performed on only 
part of the information using a compressed data format. For instance, the correction process is preferably accomplished 
by a digital printer that receives the print data in a compressed format. 

Turning now to Figure 1, displayed therein is a block diagram of a digital printing system 50 in which the present 
invention finds particular use. System 50 includes an image input terminal (NT) 52 that may include any number of 
30 image sources such as a color scanner 54 or storage medium (disk) 56 suitable for generating or otherwise providing 
a digital document 58. A digital document containing an image is the output of the NT, and is provided to image handler 
60 that forms a part of the printing system, image handler 60, while preferably providing additional functionality, includes 
an electronic subsystem (ESS) for carrying out the image processing and compression operations in accordance with 
the present invention. 

35 In a JPEG compression embodiment, image handler 60 includes an image blocking circuit 62 capable of dividing 

the digital data representing the image into a plurality of M X M blocks or segments. In one embodiment, the blocking 
operation may be accomplished by a windowing or cropping circuit that enables the transfer of data comprising one 
or more M X M blocks of data from the input document to an M X M data buffer 68. The image blocking operation 
preferably operates to identify segments of 8 pixels by 8 scanlines for each of the three color separations. Once stored 

40 jn a data buffer that is part of the image processing circuit, the data is next operated on by the JPEG compression 
circuitry depicted as block 64. In block 64, the data may be operated on using various compression operations asso- 
ciated with the JPEG compression standard to accomplish the compression of the image data within a block. As will 
be described with respect to the following figures, certain aspects of the JPEG compression operation are preferably 
performed in conjunction with the image compression operations represented by JPEG compression block 64. 

45 Once compressed, the M X M block of data is then preferably processed by image processor 66, where the first 

phase color correction of a block is accomplished. Image processor 66 may be a software driven process operating 
on a CPU within the image processing system, or it may be a specialized piece of hardware. The output of the image 
processor 66 is a coded or compressed unit of data that is either subsequently stored in electronic precollation (EPC) 
memory 70, depicted in the figure as a disk, or further decompressed at JPEG decompression block 68 before under- 

50 going the second phase color correction at image processing block 72. 

A concise discussion of the JPEG compression standard may be found in the Encyclopedia of Graphics File For- 
mats , by J. D. Murray and W. vanRyper, pp. 159-171 (1994, O'Reilly & Associates, Inc.). Further description of the 
JPEG standard may be found, for example, in JPEG Still Image Data Compression Standard , by W. Pennebaker and 
J. Mitchell, 1 993 (Van Nostrand Reinhold, New York) or Discrete Cosine Transform: Algorithms, Advantages and Ap- 

55 Plications , by K. Rao and P. Yip, 1990 (Academic Press, San Diego). 

As depicted in Figure 1 , IOT 74 is preferably a raster output scanning (ROS) print engine including a laser driving 
circuit 76 that controls or modulates laser 78 in accordance with decompressed, color corrected digital data produced 
by image processor 72, which may also operate in conjunction with various aspects of image processor 66. One or 
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more lasers in the ROS-based IOT 74 is used to illuminate or expose a photoresponsive member 84 by reflecting the 
laser generated light beam off of the plurality of surfaces found on rotating polygon 80 so as to create, by scanning, a 
latent image on member 84. 

Once the latent image is produced, it would be developed in accordance with any of a number of methods known 
s to those skilled in the art to produce a visible image. It will be further appreciated that the digital image data may be 
employed to drive or otherwise control any number of image output terminals, particularly color output devices where 
the data representing an image typically includes at least four color separations (e.g., cyan, magenta : yellow and black) 
each processed and stored as a separate image plane or in luminance-chrominance form to further reduce storage 
requirements. 

10 Having described the general operation of a printing system employing the present invention, attention is now 

turned to specific details of the operation of the compression and decompression blocks (64 and 72) working in con- 
junction with image processors 66 and 72. With reference to Figure 2 there is depicted a flow diagram illustrating the 
various processing steps in which processing of the image data is accomplished. Initially, compressed image data in 
the form of a digital document 100 comprising a plurality of coded or compressed units (representing the compressed 

75 color image in a three-dimensional color space such as YC r C b ), is provided to partial decompression block 1 02. Partial 
decompression block 102 is intended to partially decompress the coded units. For example, in the preferred JPEG 
image compression embodiment depicted in Figure 3, the coded units are decompressed into a series of discrete 
cosine transform (DCT) coefficients using: (a) a variable length (Huffman) decoding operation 200; (b) an N X N sub- 
block extraction operation 202; followed by (c) an inverse DCT operation 204, performed only on the N X N sub-block 

20 of coefficients. The result of the partial decompression step is a partially decompressed image 104, including the DC 
coefficient and possibly AC coefficients as well, as will be described below. 

It will be appreciated that the DCT coefficients within the partially decompressed image data 1 04 may be processed 
using color correction or adjustment operations, particularly applied to the DC and low order AC terms. These terms 
may be processed using matrix-based or tetrahedral interpolation operations on the N x N coefficient set to accomplish 

25 the color correction for the DC and low order AC terms, with the understanding that the higher order AC coefficients 
will have little impact on the perceived color of the block. 

Referring to Figures 2 and 3, the partially decompressed data is provided to the first phase color correction block 
108 where tetrahedral interpolation processing is performed to complete the color correction transformation. Recog- 
nizing that the most visually significant information is represented in the first few coefficients for each DCT block (the 

30 DC component indicating the average color), this data serves as the basis for the first color correction transformation. 
The color correction operation may be generally characterized as a function that maps a set of device independent or 
visually based color coordinates, for example, YC r C b to a corresponding set of device coordinates Y'C r 'C b '. Due to the 
complex nature of this function, it is usually implemented as a three dimensional (3-D) lookup table with 3-D interpo- 
lation. It is important to note that the color correction function does not change the orientation of the color space (in 

35 this example, a luminance dimension Y, and two chrominance dimensions C p C b ). Rather, it alters the coordinate 
locations in the color space to reflect the characteristics of a particular device. The color correction function is applied 
to an image corresponding to the sub-matrix of DCT coefficients. 

Further reference with respect to color correction transformation can be found, for example, in Principles of Color 
Reproduction, J.A.C. Yule, John Wiley & Sons, Inc. New York, 1967 (see p. 267-268). In a preferred embodiment, the 

40 proposed color correction method uses a fraction of the coefficients in a compressed block (i.e. N x N coefficients out 
of the original M X M coefficients) to directly generate the color corrected image. 

Computational efficiency is improved by matrix processing of only a portion of the DCT coefficients. It will be 
appreciated that techniques may be applied to processing DCT coefficients to accomplish color correction. 

More specifically, let the description for the DCT coefficients of a transformed block of 8x8 pixels of a single color 

45 separation in the transform coder (JPEG) be: 

yu ••• yu 

The description of the NxN lowest frequency coefficients is: 



so 
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The color correction process is preferably applied only to a subset of NxN coefficients. These coefficients are 
obtained by inverse transforming the NXN lowest frequency DCT coefficients using an NxN inverse DCT If the DCT 
of size NxN is given by the NxN matrix C N whose entries are: 



15 



'\N \ 2N J 



; i = 0,... 9 N; j = 0,...,AT 



where, a 0 = 1/V2, a^ 0 = 1 , the NXN pixels used for color correction are obtained by performing the following matrix 
multiplication, wherein fast equivalent implementation methods may be applied. 
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The NxN samples Zy are used as input for the color correction process. The block with NxN color corrected 
30 samples is denoted by the samples x^. The image can be either decompressed or recompressed. In the latter case, 
the DCT coefficients are restored to their original form by applying a forward DCT of size NXN. Hence, 



35 



40 



yoo y Q y 
y\o y u 

y^-uo yv-u 



yoM-\ 
yu*-\ 



N 



Mo 



V 0I 



v 0,AM 



c T 



The new coefficients yy are used to replace the old ones in the original block, prior to the full 8x8 inverse DCT 
For example, if N=2, the DCT is defined as: 
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so that the samples for color correction are obtained as 



-iJUo yuh -U 



which are color corrected obtaining xij. Accordingly, the samples to be applied as a replacement in the original block 
are found as 
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Once the first phase color correction transformation has been accomplished at step 1 08, the data is again partially 
decompressed, but now is in the form of a device-dependent color space 11 0. In the JPEG compression embodiment, 
depicted in Figure 3, the partially decompressed, device-dependent data is then integrated or merged (block 208) with 
the remaining, unprocessed DCT coefficient data before being completely decompressed as represented by complete 

w decompression block 112 in Figure 2 and inverse DCT compression block 210 in Figure 3. Once fully decompressed 
data 114 is obtained as the result of the complete decompression operation 112, the decompressed data is passed to 
the second phase color correction, block 118. This phase performs a simple color space conversion to the printer 
signals, C, M, Y, K. For example, if the first phase color correction is a mapping from device independent YCrCb to 
device dependent Y'C r 'C b \ then the second phase maps device dependent Y'C r 'C b ' to the printer signals CMYK. This 

is would be accomplished in several steps, all of which would be substantially simpler than the first phase color correction. 
First, a 3X3 matrix may be used to map Y'C r 'C b ' to CMY as follows: 



20 



C 
M 
Y 



= [Corr.Coeff] 



y 

c; 



where Corn Coeff represents the coefficients of the 3X3 matrix. 

25 in block 1 1 8, the device-dependent data is further processed in accordance with well-known techniques to produce 

data representing a plurality of color separations, preferably at least three, for rendering by a color image output device 
such as a printer. Processing the data includes the processes of under color removal (UCR), where a CMY component 
of the image is subtracted, along with gray component replacement (GCR) where the subtracted CMY is replaced, in 
part, by a K component. Moreover, the second phase processing may include linearizing the color separations or similar 

30 processing to adjust the tonal reproduction of the output image produced in response to output data 1 20 (e.g., CMYK). 

In summary, the process of Figure 2 first accomplishes a YCrCb to Y'Cr'Cb' transformation in the DCT domain. 
The result of this transformation leaves the low order DCT terms in a color space that is compatible with the high order 
terms (which have not had any processing done to them). Then in a subsequent transformation of the fully decom- 
pressed data a simpler form of correction is employed to convert from Y'Cr'Cb to CMY or CMYK, which is good enough 

35 since the low order terms have already been converted to a form for which the simpler conversion is sufficient. 

Also depicted in Figure 2 is an optional series of operations 130 that would be carried out in accordance with yet 
another alternative embodiment. In optional section 130, the partially decompressed data 11 0 may be recompressed 
and stored, block 1 32, and subsequently retrieved and partially decompressed, block 1 34. The intent of the alternative 
embodiment is to generally represent those operations that might be employed if the image being processed were not 

^0 going to be immediately rendered by an output device. For instance, in the JPEG image compression embodiment, 
the recompression and store operation would take the partially decompressed device-dependent data, merge it with 
the remaining DCT coefficient data, recompress the merged DCT data (e.g., Huffman encoding) and store the data as 
a compressed JPEG image. Subsequently, when the image is to be rendered, it is retrieved and decompressed com- 
pletely, resulting in decompressed data 114 which may be further processed as previously described with respect to 

4S the second phase color space transformation. In yet another alternative embodiment, the operations depicted in Figure 
2 may be accomplished during the compression of a color image so as to produce a compressed image for storage 
as described with respect to the optional operations 1 30. 

Figure 2 depicts a generalized color correction system operating on compressed digital images, and is not specif- 
ically limited to color correcting JPEG compressed images as represented by Figure 3. Those skilled in the art will 

50 appreciate that the operations depicted in and described with respect to Figure 2 have application in alternative lossy 
compression schemes as well as lossless compression schemes. For example, an alternative embodiment may apply 
aspects of the present invention to LZW-compressed images as will be described in more detail with respect to Figure 
6. Those skilled in the art will further appreciate that aspects of the present invention may be applied to compressed 
images (a) during decompression, (b) during compression, or (c) as a separate process carried out on previously 

55 compressed images which are subsequently recompressed. 

Color correcting a compressed color image having been generally described, attention is now turned to Figures 4 
and 5 where further details of the JPEG compressed image embodiment are illustrated. In particular, Figure 4 depicts 
the order in which quantized coefficients are rescanned in accordance with the zigzag (diagonal) path employed in 
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JPEG compressed images. As is well-known to those skilled in the art, the DC coefficient is represented in the upper- 
left corner 250 of the 8 X 8 coefficient matrix, and is surrounded by the lower order AC terms. In one of the JPEG 
image embodiments of the present invention, denoted as 1X1, only the DC coefficient 255 is employed in the color 
space transformation operation (Phase I), as shown in Figure 5. For example, color facsimile compression/processing 
might only require that the transformation be done on the DC term. Other embodiments, denoted 2x2 and 3X3 are 
also depicted in Figure 5, with the coefficient sets 260 and 265, respectively, included in the color space transformation 
operations previously described. 

Empirically, it has been observed that there is little difference between the 1X1, 2X2 and 3x3 alternatives. The 
most noticeable impacts on a rendered color image occur in those regions where the higher order terms are large 
enough to make a significant contribution to the block, for example, edges where there is a significant hue change and 
to a lesser extent edges where there is a chrominance change. 

The adaptive alternative, also depicted at the bottom of Figure 5, is designed to employ a variable-sized set of 
DCT coefficients in the first phase color correction operation. In particular, the coefficients are first analyzed to determine 
a block size 270 that may be based upon the relative values of the first nine (3x3) DCT terms or the relative location 
of the terms in color space (e.g., based upon DC color average). Depending upon the relative sizes of the low order 
terms or color space location, the number of terms to be employed may be modified. 

The present invention is intended to reduce the number of processing steps and/or hardware necessary to provide 
color correction, particularly with respect to pre-compressed images. In order to demonstrate the advantages of such 
a system, relative to a "standard" tetrahedral-interpolation system, an analysis of the mathematical operations carried 
out for each of the alternatives was conducted. For a color correction operation combining phases I and II, the "standard" 
tetrahedral interpolation approach yielding four color separations requires (19 lookups + 2.5 comparisons + 1 4 additions 
+ 12 multiplications + 2 shifts) times 64 pixels per 8 X 8 block of JPEG compressed data. The resultant number of 
operations is represented in the first row of Table 1 . The respective number of operations is also depicted for each of 
the three determinable alternatives, listing the total number of operations for phase I and phase II processing and the 
percentage reduction in the total number of operations with respect to the "standard" method. 



Table 1* 





Look-Ups 


Comparisons 


Additions 


Multiplications 


Shifts 


"Standard 

n 


1216 


160 


896 


768 


128 


1X1 


719 


40.9 


131 


18.8 


459 


48.8 


9 


98.8 


68 


46.9 


2X2 


764 


37.2 


138 


13.8 


508 


43.3 


36 


95.3 


80 


37.8 


3X3 


855 


29.7 


151 


6.3 


595 


33.6 


81 


89.5 


84 


34.4 


Tor each operation, the (average case) number of operations per block for the first stage is shown in the left 
sub-column, and the number for the second stage is shown in the right sub-column. The standard method has only 
one stage. 
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The lossy compression embodiment of the present invention having now been described, reference is made to 
Figure 6 where a flowchart depicting the steps of a lossless embodiment is found. Typical lossless compression 
schemes generate sequences of symbols and codes. By transmitting compact codes, indicating indirectly which pre- 
viously seen symbol is to be used, lossless schemes achieve data compression. In particular, the LZW and other 
lossless compression algorithms would be modified to treat as symbols, pixels (defined by 24-bit values i.e., repre- 
senting 3 color separations) rather than bytes. Some forms of lossless compression, e.g. pixel-based run-length en- 
coding, already treat pixels as symbols, and would therefore not require any modification. By losslessly compressing 
using 24-bit symbols as depicted by step 310, the "symbols" can be color corrected (Phase I) once and then the 
corrected "value" can be employed for any subsequent occurrence of the same symbols. This approach would reduce 
the number of operations that need to be applied to accomplish color correction of losslessly compressed images, 
since the operations would be applied only to a portion of the data in the compressed file, which should contain less 
data than the uncompressed file. 

As illustrated in Figure 6, the lossless compression operation 310 employs 24-bit symbols. Strings of these symbols 
are stored in a string table 312. During compression of image data, the system maintains a current prefix, which is a 
string known to be in the string table, and which contains the last few symbols seen on the input. Each time a 24-bit 
pixel value is received, if the current prefix with that symbol added is still a string in the table, the current prefix is 
changed. Otherwise, the table is updated, and the encoding for the current prefix is sent, followed by the new symbol 
(step 314). It will be appreciated by those familiar with Lempel-Ziv compression schemes that the compression oper- 
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ations in region 300 of Figure 6 are modified primarily to accommodate 24-bit symbols. Data compressed in this way 
may be stored, or transmitted on a low-bandwidth channel, but in the context of this invention it will be eventually 
displayed and/or printed. 

Prior to display or printing, the compressed data may be further processed to accomplish color correction (either 
s . phase I transformation alone or phase I and II transformations concurrently) in an efficient manner as represented by 
the steps in region 302 of Figure 6. In particular, the encoded representation of a 24-bit symbol is retrieved at step 330 
and a determination is made at step 332 as to whether the symbol is found in string table 340. If not, the symbol is 
transformed using phase 1 color correction as described above to produce the color corrected value which is then 
stored in the string table. The corrected value is then substituted for the original value in the compressed file. In this 
to way the corrected value will be employed by any subsequent decompression step to losslessly reproduce each sub- 
sequent occurrence of the encoded symbol. Because a symbol need only be converted once, the number of color 
conversion operations is substantially reduced. It is reduced by a factor somewhat larger than the compression ratio, 
since only a fraction of the compressed file needs to be converted. 

A lossless compressed file for which only a 3-3 conversion has been applied would generally require exactly the 
15 same amount of space to store after conversion as before - the symbols do not change size. Another alternative is to 
perform a 3-4 conversion (i.e. the complete color conversion) to the symbols in the compressed file, and generate a 
new file, which now takes more space than the original file due to the increased number of bits required to represent 
the larger (4-color) symbols. It will be appreciated, however, that the additional space is only required for the storage 
of the 4-color symbols, and not for the encoded representations thereof. Yet another alternative is to perform a complete 
20 conversion (3-3 or 3-4, depending on the device), and then complete the decompression operation using the updated 
table, rather than re-writing the compressed file. 

Also depicted in Figure 6 is an alternative operation, step 350, where the 3-3 color corrected images could be 
further processed to produce the fourth color (e.g., black) separation. While this alternative operation is not required 
if the transformation step of 342 is employed, it would be necessary if only a 3-3 transformation is accomplished and 
25 four color separations are required for rendering. 

Other lossless compression schemes also separately describe the color values and where they are used so that 
the color values need not be expressed at every individual occurrence. In run-length encoding, for example, a color 
value is stored along with the number of successive pixels having that color value along a scan line. To perform color 
correction on the compressed image format one must apply color correction to only the color values while leaving the 
30 run lengths unchanged. 

Huffman encoding makes use of the fact that some data values (e.g. some colors) are likely to occur far more 
often in an image than others. Huffman encoding uses a set of codes for the image values, where short codes are 
used for frequently occurring values and longer codes for the infrequently occurring values. A dictionary matching 
codes to values is constructed. This dictionary allows the original values to be recovered from the codes. When Huffman 
35 coding is applied directly to the image data (and not some already compressed form), the dictionary contains the 
mapping of code values to colors. To color correct the compressed form one need only apply the correction process 
to the color values in the dictionary 

In general, one need only conduct whatever partial decompression steps are required to reveal the color values 
for the compressed image. One need not complete the decompression by determining where within the image the 
color values belong. The color correction can then be applied to the revealed color values. The resulting partially 
decompressed image can then be either recompressed or fully decompressed as desired. 

In recapitulation, the present invention is a method for color correcting digital images that have been at least 
partially compressed. In a preferred embodiment, aspects of the color correction are carried out on the compressed 
image data to improve computational efficiency. One of a number of alternative methods is employed to accomplish 
45 the color correction on lossy or losslessly compressed images. The two phase process accomplishes the first phase 
of color correction on compressed image data in conjunction with compression or decompression operations. A second 
phase of the color correction (color space transformation) is applied subsequently to the completely decompressed 
image data. Accordingly, the technique has application to any number of color imaging systems, including digital printers 
and copiers where there is a necessity to color correct compressed digital images. 

so 

Claims 

1 . A method for color correcting a compressed digital image, comprising the steps of: 

55 

retrieving from memory a compressed unit of image data; 

partially decompressing the compressed unit to produce a partially decompressed unit representing the color 
of a region of the image in a first color space; 
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performing color correction on the partially decompressed unit to produce a corrected unit in the first color 
space; and 

subsequently decompressing the entire corrected unit to produce decompressed, corrected image data. 

The method of claim 1 , wherein the step of partially decompressing the compressed unit produces a set of DCT 
coefficients and where the step of performing color correction comprises: 

determining the DCT coefficients for each of a plurality of color separations; 

inverse discrete cosine transforming the DCT coefficients to produce transformed coefficients including a DC 
term; and 

using at least the DC term of the transformed coefficients for each of a plurality of color separations, correcting 
at least one of the transformed coefficients. 

The method of claim 1 or 2 wherein the steps of partially decompressing the compressed unit and performing color, 
correction on the partially decompressed unit are carried out upon only a subset of the compressed data repre- 
senting the region of the image, the method further comprising the steps of: 

merging the subset of color space transformed data with the partially decompressed unit; 
recompressing the partially decompressed unit to generate a second compressed unit; and 
temporarily storing the second compressed unit in a memory. 

A method for color correcting a digital image in conjunction with the compression of the image, comprising: 

retrieving from memory digital image data representing the image in a first color space; 
partitioning the data into compressible units representing regions of the image; 

at least partially compressing the data within each compressible unit to produce compressed data represent- 
ative of each region of the image; 

performing color correction on the compressed data for each compressible unit to produce a corrected unit of 
compressed data; and 

storing the compressed data for each of the regions to produce a compressed image. 

The method of claim 4, wherein the step of partially compressing the data comprises: 

representing each occurrence of a compressible unit as a symbol and an associated symbol identifier, where- 
in the symbol is representative of the color of a particular image pixel; and where the step of performing color 
correction alters the color of the symbol associated with at least one symbol identifier. 

The method of claim 4, wherein the step of partially compressing the data comprises: 

discrete cosine transforming the compressible unit to produce a plurality of DCT coefficients; and where the 
step of performing color correction results in the alteration of at least one of the DCT coefficients. 

The method of claim 6, wherein the step of partially compressing the data within each compressible unit produces 
a set of DCT coefficients and where the step of performing a color correction comprises: 

determining the DCT coefficients for each of a plurality of color separations; 

inverse discrete cosine transforming the DCT coefficients to produce transformed coefficients including a DC 
term; and 

using at least the DC term of the transformed coefficients for each of a plurality of color separations, correcting 
at least one of the transformed coefficients. 

A method for color correcting a compressed digital image in conjunction with the decompression thereof, compris- 
ing: 

retrieving from memory a compressed unit of digital image data, each compressed unit representing a region 
of the image; 

performing color correction on the compressed data for each compressible unit to produce a corrected unit of 
compressed data; and 

completely decompressing the compressed unit to produce a decompressed image wherein the decom- 
pressed image is a color corrected version of an image used to generate the compressed digital image. 
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9. The method of claim 8, wherein the step of performing color correction includes: 

partially decompressing the data within each compressed unit to produce a set of DCT coefficients; 
determining the DCT coefficients for each of a plurality of color separations; 

inverse discrete cosine transforming the DCT coefficients to produce transformed coefficients including a DC 
term; and 

using at least the DC term of the coefficients for each of a plurality of color separations, correcting at least one 
of the transformed coefficients. 

10. The method of claim 8 or 9, further comprising the step of converting the decompressed, corrected image into a 
second color space image for rendering 
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(54) Color correction of a compressed image 



(57) The present invention is a method for the color 
correction of digital images that have been compressed. 
In a preferred embodiment, aspects of the color correc- 
tion are carried out on the compressed image data to 
improve computational efficiency. One of a number of 
alternative methods is employed to accomplish the color 
correction on lossy or losslessly compressed images. 
The color transformation process accomplishes color 



correction on compressed image data in conjunction 
with compression or decompression operations. A sec- 
ond, simplified phase of the color correction may be ap- 
plied subsequently to the decompressed image data in 
certain embodiments. Accordingly, the technique has 
application to any number of color imaging systems, in- 
cluding digital printers and copiers where there is a ne- 
cessity to color correct compressed digital images. 



CO 
< 

CO 
CO 

o> 

CO 

o 

Q. 

Ill 




104 



(VC r C b » 



RARTIAUY 
DECOMPRESSED 
DM* 



(*C r C b ) 



108 



PHASE I 
COLOR SPACE 
TRANSFORMATION 




(Y"C r 'C b ') 



134 



110 



t 



RECOMPRESSj J 
AND f— J 
STORE i i 



RETRIEVE 
AND 
PARTIAL 
DECOWP 




112 



114 



COMPLETE 




DECOMP. 






rv*c,'c b 'i 



(V'C r 'C b ') 


^-118 




PHASED 




UCR/GCR 




FIG. 2 





130 



-120 



OUTPUT 
DATA 



[CMY OR CMYK) 



TO PRINTER 



Printed by Jouve, 75001 PARIS (FR) 



EP 0 849 936 A3 



J 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Ap^iicuilonNuinu 

EP 97 30 9992 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation ol document with Indication, where appropriate, 
of relevant passages 



Relevant 
lo claim 



CLASS IFlCAT.Grt OF Tm£ 
APPLICATION (inl.CU) 



US 5 283 671 A (STEWART ET AL) 
1 February 1994 (1994-02-01) 

* column 4, line 8 - column 7, line 3; 
figures 1,3 * 

US 5 408 425 A (HOU) 

18 April 1995 (1995-04-18) 

* column 7, line 46 - column 8, line 51; 
figure 1 * 



1-4,8,10 



1,2,6,7 



H04N1/60 



The present search report has been drawn up for at! dalrns 



TECHNIC. F;llOS 
SEAHCriru <tnl.CUy 



H04N 



Ptooe c4 »otuch 

BERLIN 



Date ol ootnptotbft of the search 

30 December 1999 



Dudley, C 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant ff taken alone 

Y : parrjcularty relevant If combined with another 

documeni of the &ame category 
A : lechnologtasJ background 
O : non-written oHdoture 
P : Intermediate documeni 



T : theory or principle underlying the invention 
E : earfter patent docjment. but puL^a&d on. or 



E : earfter paienl docjment. but put- 

after the filing onto 
D : document cited in the applicaii ^r 
L ; document cjtod fat other rt>ea.r;«.- 



A : member ol ihe same patent Ul'i ■ - t , corr*f;pono.ry 
document 



BEST AVAILABLE COPY 



EP 0 849 936 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 97 



This annex lists the patent family members rotating to the patent documents ciloo in the above- mention *d European - - w 
Trie members as a as contained In the European Patent Office EDP file on 

TTie European Patent Office Is tn no way liable for these particulars which are merely given 1or the puipose of Informer. 

30- 



-19*9 



Patent document 
ched in search report 



Publication 
date 



Patent lamily 
mernbtir(£) 



PuUiJciiun 



US 5283671 



01-02-1994 



NONE 



US 5408425 



18-04-1995 



NONE 



For ntttto details about this annex :sm Official Journal of the European Patent Office. No. 12/32 



BEST AVAILABLE COPY 



